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DECISION SUPPORT SYSTEM TO DETECT THE PRESENCE OF ARTIFACTS 
IN PATIENTS' MONITORING SIGNALS USING MORPHOGRAMS 

FIELD OF THE INVENTION 

The present invention relates generally to expert systems, and more particularly to 
an expert system for use in assisting a providing healthcare to a patient. 

BACKGROUND 

Healthcare technology (e.g., biomedical sensors, monitoring systems and medical 
devices) is rapidly advancing in capability as well as sheer prevalence (numbers of 
devices) in the modern intensive care unit (ICU). The creation of additional data streams is 
imposing a significant "information-overload" challenge upon healthcare staff that also 
faces a critical shortage of intensive care staff to meet the needs of the ICU patient 
population. 

The present invention is therefore directed to the problem of developing a method 
and apparatus for reducing the amount of information that must be processed manually in 
an intensive care environment or other healthcare environment. 

SUMMARY OF THE INVENTION 

The present invention solves this and other problems by providing a method and 
apparatus composed of intelligent modules, which are capable of assimilating multiple data 
streams originating from a broad array of sensors and systems and able to distinguish 
clinically-significant changes in patient states from clinically-insignificant changes or 
artifacts. 
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According to one aspect of the present invention, a method for monitoring a patient 
includes: determining a first convex hull for a first set of points, each point of the first set 
of points having a first coordinate being a value of a first monitored signal at a specific 
moment in time, and having a second coordinate being a value of a second monitored 

5 signal at the specific moment in time, and determining a second convex hull for a second 
set of points, each point of the second set of points having a first coordinate being a value 
of a third monitored signal at a specific moment in time, and having a second coordinate 
being a value of a fourth monitored signal at the specific moment in time. The method also 
includes monitoring the first and second convex hulls to determine whether a perturbation 

1 0 has occurred in either of the first and second convex hulls, determining, upon detecting a 
perturbation in one of the first and second convex hulls, whether a perturbation has 
occurred in the other of the first and second convex hulls, and alerting an operator that a 
clinically significant change may have occurred in the patient if both the first and second 
convex hulls have been perturbed. 

15 According to another aspect of the present invention, a method for monitoring a 

patient includes determining convex hulls for pairs of monitored signals from the patient, 
and determining whether a perturbation has occurred in one or more of the convex hulls. 
This exemplary embodiment can also include alerting an operator that a clinically 
significant change may have occurred in the patient if each of the convex hulls has been 

20 perturbed. 

According to yet another aspect of the present invention, a method for monitoring a 
patient includes determining convex hulls for pairs of monitored signals from the patient, 
and indicating a potentially clinically significant change based on a determination that a 
perturbation has occurred in each of the convex hulls. This embodiment of a method for 

2 
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monitoring a patient can also include determining that a perturbation has occurred in one of 
the convex hulls, evaluating one or more remaining ones of the convex hulls to determine 
whether a perturbation has occurred in each of the one or more remaining ones of the 
convex hulls, upon determining that a perturbation has occurred in the one or more 
5 remaining ones of the convex hulls, determining that a clinically significant change may 
have occurred in the patient, and upon determining that a perturbation has not occurred in 
the one or more remaining ones of the convex hulls, determining that an artifact may exist 
in the pairs of monitored signals. 

According to still another aspect of the present invention, a method for monitoring 
10 a patient includes indicating that a clinically significant change may have occurred in the 
patient if perturbations exist in convex hulls of plots of monitored signal pairs; and 
indicating that an artifact may exist in one or more monitored signals if a perturbation 
exists only in a subset of the convex hulls of the plots of monitored signal pairs and not in 
a remaining ones of the convex hulls of the plots of monitored signal pairs. 
1 5 According to yet another aspect of the present invention, an apparatus for 

monitoring a patient includes a processor and a memory. Multiple leads, each receiving a 
monitored signal from the patient, connect the processor to the patient. The memory stores 
a value of each of the leads at a multiple points in time. The processor determines convex 
hulls for multiple pairs of signals from the leads, and determines whether a perturbation 
20 has occurred in one or more of the convex hulls. This embodiment can also include a 

interface coupled to the memory and the processor, wherein the processor outputs an alert 
signal to the user interface to indicate that a clinically significant change may have 
occurred in the patient if perturbations exist in a plurality of convex hulls of a plurality of 
plots of monitored signal pairs, or indicating that an artifact may exist in one or more of a 

3 
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plurality of monitored signals if a perturbation exists only in a subset of the plurality of 
convex hulls of the plurality of plots of monitored signal pairs and not in a remaining ones 
of the plurality of convex hulls of the plurality of plots of monitored signal pairs. This 
embodiment can also include a display coupled to the processor to display each of the 
5 signals from the leads and to display plots of each of the signals with respect to one 
another. In some cases, the display can overlay a calculated convex hull for each of the 
plots. 

The above methods can also be stored in computer readable media as instructions 
for programming a processor to monitor a patient. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG 1 depicts an exemplary embodiment of a flow chart of a method for processing 
multiple data streams according to one aspect of the present invention. 

FIGS 2-4 depict vector cardiograms of H 12, V 13 and ABP 14 signals for a 
1 5 Respiratory Failure Patient. 

FIGs 5-7 depict an example of proportional perturbations in all the morphograms 
for a respiratory failure patient due to a potentially clinically significant change in the 
patient according to one aspect of the present invention. 

FIGs 8-10 depict an example of non-consistent perturbations in the different 
20 morphograms that indicates artifacts presence according to another aspect of the present 
invention. 

FIG 11 depicts an exemplary embodiment of a method for monitoring a patient 
according to yet another aspect of the present invention. 
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FIG 12 depicts an exemplary embodiment of an apparatus for monitoring a patient 
according to still another aspect of the present invention. 

DETAILED DESCRIPTION 
5 It is worthy to note that any reference herein to "one embodiment" or "an 

embodiment" means that a particular feature, structure, or characteristic described in 
connection with the embodiment is included in at least one embodiment of the invention. 
The appearances of the phrase "in one embodiment" in various places in the specification 
are not necessarily all referring to the same embodiment. 
1 0 As used herein, a monitored signal comprises any signal that is being monitored by 

a monitoring device or system. Examples of monitored signals include but are not limited 
to electrocardiogram signals, morphogram signals, pulse rate signals, respiratory signals, 
brain waves, etc. 

The present invention includes a system composed of intelligent modules, which 
15 are capable of assimilating multiple data streams originating from a broad array of sensors 
and systems and able to distinguish chnically-significant changes in patient states versus 
clinically-insignificant changes or artifacts. The present invention includes a method for 
data stream fusion, which will enable multi-parameter monitoring capabilities. 

The present invention also includes a method and a system to detect artifacts in a 
20 given monitored signal (or a set of monitored signals) based on the collective behavior of 
the set of monitored signals (e.g., morphograms), which represents the patient's current 
clinical conditions. 

Morphograms represent the relationship between two signals by showing the loci of 
the time variation. Morphograms are already used in MRI for gating, where images have 
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to be captured at an exact point of time. It's used for the diagnosis of coronary artery 
disease using MRI and for hemodynamic illustration. 

The physician (or expert) validates the correctness of the hemodynamic signals 
recorded for a short span of time (generally, monitoring systems record - 125 sample per 
5 second, so, a few minutes period is adequate). FIG 1 shows a sample of such signals that 
are accepted as valid signals for the patient under examination. For example, FIG 1 shows 
the MCL1 11, II 12, V 13, ABP 14, PAP 15, PLETH 16 and RESP 17 lead signals from a 
morphogram system. These represent examples of monitored signals. 

Plotting the relationship between every pair of signals under study (for this case, 
10 let's look at the n 12, V 13 and the ABP 14 signals) gives loci of the relationship between 
every pair as it changes with time, 

FIGs 2-4 shows a plot of the relationship between pairs of signals for the II 12 and 
V 13 leads, as well as the ABP 14, respectively, on a patient with respiratory failure. With 
three signals of interest, one can plot three simultaneous plots (as shown in FIGs 2-4) to 
1 5 capture the hemodynamic changes in the patient with time. 

Each of the subplots has a well-defined shape that repeats itself with time as long as 
the patient is not undergoing any clinically significant changes. As there is a persistent 
pattern of correlation between the hemodynamic measures, an isolated change {e.g., a 
change in a single subplots/morphogram) that is not accompanied by comparable changes 
20 in the remaining morphogram subplots reflects a substantial problem with the signals being 
plotted in this subplot, such as the presence of an artifact. However, a comparable change 
(or perturbation) in ALL the signals' morphograms comprises a clear indication of a 
clinically significant change in the patient's condition and is NOT due to artifacts. FIGs 5- 
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7 show the perturbations with the same patient due to clinical changes in the patient's 
condition for the same II 12, V 13 and ABP 14 signals plotted with respect to each other. 

According to one aspect of the present invention, perturbations due to clinical 
changes in the patient's condition can be distinguished from perturbations due to artifacts, 
5 in that the perturbation due to an artifact will only take place in a number of the 

morphogram subplots and not all of the subplots, whereas perturbations due to a change in 
a patient's clinical condition will occur in all of the morphogram subplots. For example, a 
movement by the patient that affects lead II 12 but not others will affect the plots in which 
the relationship between the signal from lead H 12 and other signals is being plotted. Thus, 
10 more than one plot can be affected by an artifact in a single lead signal, but not all. 

FIGs 8-10 shows the result of an artifact present in signals being monitored from a 
patient on the various subplots used in FIGs 2-7 in a patient with pulmonary edema. The 
shape perturbations apparent in FIGs 9 and 10 (i.e., the second and third morphogram 
subplots) are not proportional to the perturbation on the first morphogram subplot (which 
15 is the only ECG-based morphogram). This is a clear indication of artifact presence in the 
signal common in the second and third morphogram subplots, namely, the ABP 14 signal. 

According to another aspect of the present invention, the shape perturbation can be 
easily and efficiently quantified by examining the convex hull of the shape under study. A 
convex hull is the smallest convex set containing the points at issue. One can think of a 
20 convex hull as a rubber band wrapped around the "outside" points. Convex hulls are 
unique and can be efficiently computed for a random number of points. 

According to another aspect of the present invention, a method for detecting 
artifacts can be summarized as: 

Is shape (Convex hull) perturbed in a SUBSET of morphogram subplots? 

7 
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If yes: 

Is shape (Convex hull) perturbed consistently in the remaining? 
If yes -> No artifacts but CLINICALLY SIGNIFICANT 

Else ARTIFACT detected in the monitored signal 
Turning to FIG 1 1 , shown therein is an exemplary embodiment 1 1 0 of a method for 
monitoring a patient. 

In step 111, electrocardiogram samples are obtained from a patient at a first 
moment in time. For example, samples Ell, E21, E31 are obtained from electrode 1, 
electrode 2 and electrode 3 at time tl. 

In step 112, electrocardiogram samples are obtained from a patient at another 
moment in time. For example, samples E12, E22, E32 are obtained from electrode 1, 
electrode 2 and electrode 3 at time t2. 

In step 113, multiple sets of electrode sample pairs are created. For example, set 
S12= {P121,P122, ...,P12n} is created from a pair of samples, in which P121=(E11, 
E21), P122=(E12, E22), and P12n=(Eln, E2n). Set S13={P131, P132, . . ., P13n} is 
created, in which P131=(E1 1, E31), P132=(E12, E32), and P13n=(Eln, E3n). Set 
S23={P231, P232, . . ., P23n} is created, in which P231=(E21, E31), P232=(E22, E32), and 
P23n=(E2n, E3n). For more than three samples, similar sets would be created for the other 
pairs. 

In step 1 14, convex hulls are created for each set of points. Any standard technique 
can be employed for calculating the convex hull. For example, one technique known as the 
Gift Wrapping algorithm operates as follows: 

(1) Find least point A (with minimum y coordinate) as a starting point. 
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(2) Find B where all points lie to the left of AB by scanning through all the points. 
To determine if a point is to the left of the line AB can be determined by calculating the 
area of a triangle involving the three points of interest {i.e., the two on line AB and the 
point of interest). The area of the triangle P0P1P2 where P0=(*0,y0), Pl=(xl,yl) and 
P2=(x2 3 y2) is: 



xO jcI x2 
yO yl y2 
1 1 1 



If the area is positive then the points occur in anti-clockwise order and P2 is to the left of 
the line P0P1. If the convex hull is kept in anti-clockwise order then this area will be 
positive for any three consecutive points on the hull. If the area is negative then they are in 
10 clockwise order. Finally, if the area is zero the three points are collinear. 

(3) Find C where all points lie to the left of BC. 

(4) Repeat step 3 to find the next point and so on until reaching point A. 
Other algorithms may be used to determine the convex hulls. 

In step 1 15, each of the convex hulls are monitored to determine whether there are 

15 any perturbations in them. A perturbation can be determined by comparing the current 

convex hull to the prior convex hull and identifying a significant difference, such as a new 

vertex that lies a significant difference away from a last vertex. For example, a significant 

difference could be a value that lies several standard deviations from the mean, or some 

large percentage difference from the centroid or other predetermined threshold. 

20 In step 116, once a perturbation is noted in one of the convex hulls, each of the 

other convex hulls is examined for similar perturbations. 

In step 1 17, a clinically significant change is identified as potentially having 

occurred as similar perturbations are detected in each of the convex hulls. 
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In step 1 18, an artifact is determined to possibly exist in the electrocardiogram 
signals as no similar or consistent perturbations have been detected in the other convex 
hulls, despite there being perturbations in a subset of convex hulls. 

The process then continues as long as the patient is being monitored. In each of the 
5 determinations in steps 1 17-1 18, a user can be notified so that a physician, if necessary or 
desired, can make a medical judgment. 

Turning to FIG 12, shown therein is an exemplary embodiment of an apparatus for 
monitoring a patient according to yet another aspect of the present invention. The 
apparatus 120 includes multiple leads 121 to connect to a patient or other monitoring 
1 0 equipment to obtain the monitored signals. 

The monitored signals are then fed to a processor 122 that determines the various . 
interrelationships between the various monitored signals, as described above. The 
processor also calculates the convex hull for each of the interrelationships determined. The 
plot of the interrelationships and the convex hulls can be displayed on display 124. Any 
1 5 processor capable of performing these relatively simple calculations can be employed, such 
as an Intel Pentium processor, or a computer having this chip as its main cpu. 

All programming necessary to program processor 122 can be stored in memory 
123. Memory 123 can also store the values being used by the processor to determine 
whether clinically significant events have occurred or whether an artifact has created noise 
20 in the monitored signal or signals. Memory 123 can also store intermediate calculations 
necessary by processor 122 to arrive at the above-described determinations. Memory 123 
can be a random access memory having a capacity sufficient to store several days worth of 
samples of the monitored signals, as well as the programming necessary to program 
processor 122 and memory used by processor 122 to support its calculations. Several 

10 
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gigabytes should be sufficient for this purpose. Memory 122 can also be a disk drive, a 
series of memory sticks, etc. 

User interface includes a keyboard, a mouse and other audio and visual indicators 
that alert an operator that a clinically significant change may have occurred in a patient, as 
5 opposed to an artifact, which may also require attention. 

Although various embodiments are specifically illustrated and described herein, it 
will be appreciated that modifications and variations of the invention are covered by the 
above teachings and are within the purview of the appended claims without departing from 
the spirit and intended scope of the invention. For example, certain signals are discussed 
10 as being monitored signals, however, other signals are also possible for use in the 

techniques herein without departing from the scope of the present invention. Moreover, 
certain techniques for calculating the convex hull are set forth herein, but other techniques 
would also suffice. Furthermore, these examples should not be interpreted to limit the 
modifications and variations of the invention covered by the claims but are merely 
15 illustrative of possible variations. 
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CLAIMS : 

1 . A method (50) for monitoring a patient comprising: 

determining (54) a first convex hull for a first plurality of points, each point of the 
first plurality of points having a first coordinate being a value of a first monitored signal at 
a specific moment in time, and having a second coordinate being a value of a second 
monitored signal at the specific moment in time; 

detennining (54) a second convex hull for a second plurality of points, each point 
of the second plurality of points having a first coordinate being a value of a third monitored 
signal at a specific moment in time, and having a second coordinate being a value of a 
fourth monitored signal at the specific moment in time; 

monitoring (56) the first and second convex hulls to determine whether a 
perturbation has occurred in either of the first and second convex hulls; 

determining (57), upon detecting a perturbation in one of the first and second 
convex hulls, whether a perturbation has occurred in the other of the first and second 
convex hulls; and 

alerting (58) an operator that a clinically significant change may have occurred in 
the patient if both the first and second convex hulls have been perturbed. 

2. A method (50) for monitoring a patient comprising: 

determining (54) a plurality of convex hulls for a plurality of pairs of monitored 
signals from the patient; and 

determining (56) whether a perturbation has occurred in one or more of the 
plurality of convex hulls. 

12 
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3. The method (50) according to claim 2, further comprising: 

alerting (58) an operator that a clinically significant change may have occurred in 
the patient if each of the plurality of convex hulls has been perturbed. 

4. A method (50) for monitoring a patient comprising: 

determining (54) a plurality of convex hulls for a plurality of pairs of monitored 
signals from the patient; and 

indicating (58) a potentially clinically significant change based on a determination 
that a perturbation has occurred in each of the plurality of convex hulls. 

5. The method (50) according to claim 4, further comprising: 

determining (56) that a perturbation has occurred in one of the plurality of convex 
hulls; and 

evaluating (57) one or more remaining ones of the plurality of convex hulls to 
determine whether a perturbation has occurred in each of the one or more remaining ones 
of the plurality of convex hulls. 

6. The method (50) according to claim 5, further comprising: 

upon determining (57) that a perturbation has occurred in the one or more 
remaining ones of the plurality of convex hulls, determining (58) that a clinically 
significant change may have occurred in the patient. 



13 



PHUS040021USP 



7. The method according to claim 5, further comprising: 

upon determining (57) that a perturbation has not occurred in the one or more 
remaining ones of the plurality of convex hulls, determining (59) that an artifact may exist 
in the plurality of pairs of monitored signals. 

8. A method (50) for monitoring a patient comprising: 

indicating (58) that a clinically significant change may have occurred in the patient 
if perturbations exist in a plurality of convex hulls of a plurality of plots of monitored 
signal pairs; and 

indicating (59) that an artifact may exist in one or more of a plurality of monitored 
signals if a perturbation exists only in a subset of the plurality of convex hulls of the 
plurality of plots of monitored signal pairs and not in a remaining ones of the plurality of 
convex hulls of the plurality of plots of monitored signal pairs. 

9. An apparatus (120) for monitoring a patient comprising: 
a plurality of leads (121), each receiving a monitored signal from the patient; 
a memory (123) to store a value of each of the plurality of leads (121) at a plurality 
of points in time; 

a processor (122) coupled to each of the plurality of leads (121), said processor 
(122) to determine a plurality of convex hulls for a plurality of pairs of signals from the 
plurality of leads (121), and to determine whether a perturbation has occurred in one or 
more of the plurality of convex hulls. 
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10. The apparatus (120) according to claim 9, further comprising a user interface 
(125) coupled to the memory (123) and the processor (122), wherein said processor 
(122)outputs an alert signal to the user interface (125) to indicate that a clinically 
significant change may have occurred in the patient if perturbations exist in a plurality of 
convex hulls of a plurality of plots of monitored signal pairs, or indicating that an artifact 
may exist in one or more of a plurality of monitored signals if a perturbation exists only in 
a subset of the plurality of convex hulls of the plurality of plots of monitored signal pairs 
and not in a remaining ones of the plurality of convex hulls of the plurality of plots of 
monitored signal pairs. 

1 1 . The apparatus (120) according to claim 9, further comprising a display (124) 
coupled to the processor (122) to display each of the plurality of signals from the plurality 
of leads (121) and to display a plurality of plots of each of the plurality of signals with 
respect to one of the other plurality of signals. 

12. The apparatus (120) according to claim 11, wherein said display (124) overlays 
a calculated convex hull for each of the plurality of plots. 

13. A computer readable media (123) having disposed thereon instructions causing 

a processor (122) to: 

determine (54) a first convex hull for a first plurality of points, each point of the 
first plurality of points having a first coordinate being a value of a first monitored signal at 
a specific moment in time, and having a second coordinate being a value of a second 
monitored signal at the specific point in time; 

15 
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detenriine (54) a second convex hull for a second plurality of points, each point of 
the second plurality of points having a first coordinate being a value of a third monitored 
signal at a specific moment in time, and having a second coordinate being a value of a 
fourth monitored signal at the specific point in time; 

monitor (56) the first and second convex hulls to determine whether a perturbation 
has occurred in either of the first and second convex hulls; 

determine (57), upon detecting a perturbation in one of the first and second convex 
hulls, whether a perturbation has occurred in the other of the first and second convex hulls; 
and 

alert (58) an operator that a clinically significant change may have occurred in the 
patient if both the first and second convex hulls have been perturbed. 

14. The computer readable media (123) according to claim 13, wherein the 
instructions further cause the processor (122) to: 

determine (54) a plurality of convex hulls for a plurality of pairs of signals from the 

patient; and 

determine (56) whether a perturbation has occurred in one or more of the plurality 
of convex hulls. 

15. The computer readable media (123) according to claim 14, wherein said 
instructions further cause the processor (122) to: 

alert (58) an operator that a clinically significant change may have occurred in the 
patient if each of the plurality of convex hulls has been perturbed. 
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16. A computer readable media (123) having encoded thereon a plurality of 
instructions for programming a processor (122) to monitor a patient, said plurality of 
instructions comprising: 

determining (54) a plurality of convex hulls for a plurality of pairs of signals from 

the patient; and 

indicating (58) a potentially clinically significant change based on a determination 
that a perturbation has occurred in each of the plurality of convex hulls. 

17. The computer readable media (123) according to claim 1 6, wherein said 
instructions further comprise: 

determining (56) that a perturbation has occurred in one of the plurality of convex 

hulls; and 

evaluating (57) one or more remaining ones of the plurality of convex hulls to 
determine whether a perturbation has occurred in each of the one or more remaining ones 
of the plurality of convex hulls. 

18. The computer readable media (123) according to claim 17, wherein said 
plurality of instructions further comprise: 

upon determining (57) that a perturbation has occurred in the one or more 
remaining ones of the plurality of convex hulls, determining (58) that a clinically 
significant change may have occurred in the patient. 

19. The computer readable media (123) according to claim 17, wherein said 
plurality of instructions further comprise: 

17 
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upon determining (57) that a perturbation has not occurred in the one or more 
remaining ones of the plurality of convex hulls, determining (59) that an artifact may exist 
in the plurality of pairs of signals. 

20. A computer readable media (123) having encoded thereon a plurality of 
instructions for programming a processor (122) to monitor a patient, said plurality of 
instructions comprising: 

indicating (58) that a clinically significant change may have occurred in the patient 
if perturbations exist in a plurality of convex hulls of a plurality of plots of monitored 
signal pairs; and 

indicating (59) that an artifact may exist in one or more of a plurality of monitored 
signals if a perturbation exists only in a subset of the plurality of convex hulls of the 
plurality of plots of monitored signal pairs and not in a remaining ones of the plurality of 
convex hulls of the plurality of plots of monitored signal pairs. 
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ABSTRACT 

A method for monitoring a patient (110) includes determining (1 14) convex hulls for pairs 
of monitored signals from the patient, and determining whether a perturbation has occurred 
(1 15, 1 16) in one or more of the convex hulls. This exemplary embodiment (1 10) can also 
include alerting an operator that a clinically significant change may have occurred (117) in 
the patient if each of the convex hulls has been perturbed. If only a subset of the convex 
.hulls is perturbed, an artifact has probably occurred (118). 
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